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SUMMARY 


The  Basic  Attributes  Test  (BAT)  battery  is  a  computerized  test  battery  designed  to  measure  individual 
differences  in  psychomotor  skills,  information  processing  abilities,  personality  and  attitudes.  In  previous 
studies,  several  of  these  tests  have  demonstrated  utility  for  supporting  USAF  pilot  selection  decisions  and 
adding  to  the  predictive  validity  of  the  Air  Force  Officer  Qualifying  Test  (AFOOT),  the  ability  measure  currently 
included  in  the  USAF  pilot  selection  process. 

The  purpose  of  this  study  was  to  cross-validate  pilot  selection  models  that  used  a  combination  of  AFOQT 
and  BAT  test  scores  to  determine  the  general izabllity  of  the  original  prediction  models  reported  in  Carretta 
(1989).  To  perform  the  cross-validation,  885  USAF  Undergraduate  Pilot  Training  (UPT)  students  were 
assigned  randomly  to  two  groups.  Pilot  selection  models  that  used  a  combination  of  AFOQT  and  BAT  test 
scores  were  developed  independently  for  each  group.  The  "best-fitting"  regression  weights  from  each  group 
were  then  applied  to  subjects  in  the  other  group  to  determine  the  generalizabillty  of  the  regression  solutions. 

In  the  model  development  phase,  subjects  with  good  hand-eye  coordination  who  made  quick  and 
accurate  decisions  were  more  likely  to  complete  UPT  successfully  in  both  groups.  Although  there  was  some 
reduction  in  the  validity  coefficients  In  the  cross-validation  phase,  the  selection  models  were  related 
significantly  to  UPT  final  outcome  in  both  groups.  These  results  suggest  that  the  AFOQT/'BAT  pilot  selection 
models  are  robust  enough  to  be  used  as  adjuncts  to  operational  USAF  pilot  trainee  selection  procedures. 
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CROSS-VALIDATION  OF  EXPERIMENTAL  USAF 
PILOT  TRAINING  PERFORMANCE  MODELS 


I.  INTRODUCTION 

In  1955,  the  United  States  Air  Force  (USAF)  discontinued  the  use  of  apparatus-based  testing  as  a 
component  of  its  aircrew  selection  and  classification  system.  Previously,  several  testing  devices  had  provided 
perceptual  and  motor  skill  measures  that  were  useful  for  classifying  aircrew  applicants  into  job  specialties 
(pilot  versus  navigator)  and  for  predicting  preliminary  flight  training  outcome  (Passey  &  McLaurin,  1966). 
Apparatus-based  testing  was  discontinued  primarily  for  administrative  reasons  including  (a)  the  decision  to 
decentralize  the  selection  process,  and  (b)  the  difficulty  of  keeping  the  electromechanical  testing  devices 
calibrated  and  the  test  administration  procedures  consistent  across  multiple  test  sites  (McGrevy  &  Valentine, 
1974). 

Since  then,  the  variables  considered  in  pilot  candidate  selection  have  included  medical  fitness,  academic 
performance,  aptitude  test  scores,  biographical/background  data  (e.g.,  age,  college  activities,  type  of  college 
degree)  and  previous  flying  experience.  Despite  the  demonstrated  validity  of  current  USAF  pilot  candidate 
selection  procedures  for  predicting  training  performance,  the  increasing  expense  of  pilot  training  and  the 
demands  associated  with  modern  aircraft  make  it  crucial  that  the  best-qualified  pilot  training  applicants  be 
selected. 

Recently,  several  studies  have  demonstrated  the  utility  of  a  computerized  test  device  known  as  the  Basic 
Attributes  Test  (BAT)  system  for  adding  to  the  predictive  validity  of  currently  used  USAF  pilot  selection 
procedures  (Bordelon  &  Kantor,  1986;  Carretta,  1989;  Kantor  &  Carretta,  1988).  Based  on  these  results,  eight 
tests  from  the  BAT  battery  are  currently  under  review  as  adjuncts  to  the  selection  process  of  Undergraduate 
Pilot  Training  (UPT)  students. 

Concerns  have  been  raised  regarding  the  stability  of  the  pilot  selection  model  (Carretta,  1989)  because 
the  final  selection  model  was  developed  using  a  stepwise  regression  approach  and  because  there  is  some 
evidence  of  redundancy  among  the  test  measures.  Therefore,  a  different  final  regression  solution  could  occur 
with  a  different  sample.  The  present  investigation  was  conducted  to  cross-validate  these  results  in  order  to 
determine  the  stability  of  the  original  prediction  model. 


II.  METHOD 


Subjects 

The  subjects  in  this  study  were  885  U.S.  Air  Force  UPT  students  from  the  Air  Force  Reserve  Officer  Training 
Corps  (AFROTC)  and  Officer  T raining  School  (OTS)  who  were  tested  on  both  the  Air  Force  Officer  Qualifying 
Test  (AFOOT)  and  BAT  batteries.  Of  these  subjects,  478  also  had  been  used  In  the  original  validation  study 
(Carretta,  1989).  All  subjects  already  had  been  chosen  for  UPT  on  the  basis  of,  in  part,  their  AFOOT  scores. 
The  BAT  battery  currently  is  not  part  of  the  operational  USAF  pilot  candidate  selection  procedure. 

Subjects  ranged  in  age  from  21  to  27  years  (M  =  23.2,  SD  =  1.6).  All  subjects  had  completed  at  least  a 
4-year  college  degree  before  entering  UPT.  Subjects  were  Informed  that  their  performance  on  the  BAT  battery 
would  not  affect  their  continuation  in  UPT,  would  not  be  entered  into  their  permanent  service  records,  and 
would  be  used  only  for  developing  an  improved  USAF  pilot  candidate  selection  model. 


Instrumentation 

AFOOT.  The  AFOOT  is  a  paper-and-pencil  aptitude  test  battery  used  to  select  civilian  or  prior-service 
applicants  for  officer  precommissioning  training  programs  and  to  classify  commissioned  officers  into  aircrew 


1 


job  specialties  (pilot  versus  navigator).  The  battery  consists  of  16  subtests  that  assess  five  ability  domains: 
verbal,  quantitative,  spatial,  aircrew  interests/aptitude,  and  perceptual  speed  (Skinner  &  Ree,  1987).  Fourteen 
of  the  AFOOT  subtests  are  used  to  compute  the  Pitot  and  Navigator-Technical  composite  scores  used  in  the 
operational  selection  of  pilot  candidates  (US  Air  Force,  1983). 

Basic  Attributes  Test  (BAT).  The  BAT  battery  used  in  this  study  consisted  of  eight  computerized  tests 
that  assessed  individual  differences  in  psychomotor  coordination,  Information  processing  ability,  personality, 
and  attitudes.  The  types  of  scores  generated  include  tracking  error,  response  time,  response  accuracy,  and 
response  choice.  Table  1  provides  a  brief  summary  of  this  battery.  A  more  detailed  description  is  provided 
byCarretta  (1987,  1989). 


Table  1 .  Basic  Attributes  Test  (BAT)  Battery  Summary 


Test  name 

Length 

(mins) 

Attributes  measured 

Types  of  scores 

Two-Hand  Coordination 
(rotary  pursuit) 

10 

Tracking  and  Time-Sharing  Ability 
in  Pursuit 

"Tracking  error 

Complex  Coordina'ion 
(stick  and  rudder) 

10 

Compensatory  T racking  Involving 
Multiple  Axes 

Tracking  error 

Encoding  Speed 

20 

Verbal  Classification 

Response  time,  response 
accuracy 

Mental  Rotation 

25 

Spatial  Transformation 
and  Classification 

Response  time,  response 
accuracy 

Item  Recognition 

20 

Short-Term  Memory,  Storage, 
Search  and  Comparison 

Response  time,  response 
accuracy 

Time-Sharing 

30 

Higher-Order  Tracking 

Ability,  Learning  Rate  and 
Time-Sharing 

Tracking  difficulty, 
response  time, 
dual-task  performance 

Self-Crediting  Word 
Knowledge 

10 

Self-Assessment  Ability, 
Self-Confidence 

Response  time,  response 
accuracy,  bet 

Activities  Interest 
Inventory 

10 

Survival  Attitudes 

Response  time,  number 
of  high-risk  choices 

UPT  performance  criterion.  UPT  final  training  outcome  was  scored  as  a  dichotomous  variable,  with 
graduates  receiving  a  score  of  1  and  ellmlnees  a  score  of  0. 


Apparatus 

The  BAT  apparatus  consisted  of  a  microcomputer  and  monitor  built  into  a  ruggedized  chassis  with  a  glare 
shield  and  side  panels  designed  to  minimize  distractions.  The  subjects  responded  to  the  tests  by 
manipulating  (individually  or  in  combination)  a  dual-axis  joystick  on  the  right  side,  a  single-axis  joystick  on 
the  left  side,  and  a  keypad  in  the  center  of  the  test  unit.  The  keypad  included  keys  tabled  0  to  9,  an  ENABLE 
key  in  the  center,  and  a  bottom  row  with  YES  and  NO  keys,  and  two  others  for  same/left  (S/L)  responses, 
and  different/right  (D/R)  responses. 
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Procedure 


Each  subject  was  administered  both  the  AFOOT  and  BAT  prior  to  entry  Into  UPT.  Pilot  candidates  were 
commissioned  through  either  AFROTC  or  OTS.  Those  from  AFROTC  were  tested  on  the  AFOOT  prior  to 
entering  college  or  while  an  undergraduate.  AFROTC  pilot  candidates  were  administered  the  BAT  while 
attending  a  Flight  Screening  Program  (FSP)  in  the  summer  following  their  junior  year  in  college.  For  the  OTS 
pilot  candidates,  the  AFOOT  was  administered  either  just  prior  to  or  after  completion  of  college,  and  the  BAT 
was  administered  at  the  beginning  of  FSP. 

The  eight  BAT  tests  used  in  this  study  were  included  in  a  longer  battery  that  required  about  3  1/2  hours 
to  complete.  After  the  test  administrator  initiated  the  battery,  the  test  session  was  self-paced.  Programmed 
breaks  of  1  or  2  minutes  were  included  between  tests  in  order  to  reduce  mental  and  physical  fatigue. 

All  pilot  candidates  went  through  the  same  UPT  program,  which  consisted  of  T-37  (Initial  jet  trainer)  and 
T-38  (advanced  jet  trainer)  training.  UPT  graduates  completed  an  average  of  190  hours  of  flying.  The  final 
training  outcome  was  determined  at  the  end  of  the  program. 


Approach 

To  be  useful  as  an  adjunct  to  currently  used  pilot  candidate  selection  procedures,  the  BAT  performance 
measures  must  demonstrate  incremental  validity  against  training  outcome  when  used  in  combination  with 
operational  instruments  (i.e.,  AFOQT  scores)  and  must  demonstrate  stability  when  cross-validated.  For  the 
cross-validations,  the  pilot  candidates  were  divided  randomly  into  two  groups.  The  assignments  were  made 
such  that  the  groups  were  similar  in  their  UPT  pass/fail  rates.  Table  2  provides  a  summary  of  the  composition 
of  each  group.  Pilot  candidate  selection  models  were  developed  independently  for  each  group,  using  UPT 
final  outcome  as  the  training  criterion. 

Table  2.  UPT  Outcome  by  Group 


Group  1 

Group  2 

N 

% 

N 

% 

Graduates 

285 

66.3 

300 

65.9 

Eliminees  (total) 

145 

33.7 

155 

34.1 

FTD 

90 

20.9 

102 

22.4 

Academic 

1 

0.2 

1 

0.2 

Medical 

18 

4.2 

14 

3.1 

MOA 

17 

4.0 

8 

1.8 

SIE 

19 

4.4 

30 

6.6 

Not*.  FTD  =»  Flying  Training  Daflclancy. 

MOA  =*  Manifeitatlon  of  Anxiety. 

SIE  »  Self-Initiated  Elimination. 

For  each  half-sample,  two  approaches  were  used  to  develop  "best-fitting"  regression  models  for 
predicting  UPT  final  outcome.  One  approach  used  a  stepwise  regression  technique  whereas  the  other 
simultaneously  entered  all  19  AFOQT/BAT  scores  (2  AFOQT  composites  and  17  BAT  summary  scores). 

The  stepwise  Inclusion  method  combined  forward  Inclusion  of  the  19  AFOQT/BAT  scores  with  deletion 
of  scores  that  no  longer  contributed  significantly  to  the  regression  solution.  This  stepwise  method  did  not 
force  any  scores  Into  the  model  initially.  The  probability  for  scores  to  enter  and  probability  to  leave  the 
regression  equation  were  set  at  .20  (Kim  &  Kohout,  1975).  Regression  weights  from  each  half-sample  were 
applied  to  the  other  half-sample  to  cross-validate  the  models  and  provide  an  estimate  of  shrinkage  in  the 
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validity  coefficients.  The  two  half-samples  were  then  combined  to  provide  a  best  estimate  of  the  regression 
weights  for  the  pilot  candidate  selection  models. 


III.  RESULTS 


Prediction  of  UPT  Final  Outcome 


Stepwise  Regression  Approach.  Table  3  presents  the  results  of  regressing  various  predictor 
combinations  on  UPT  final  outcome.  The  objective  was  to  identify  the  best  combination  of  predictors  to  use 
in  support  of  pilot  selection  decisions. 

Table  3.  Prediction  of  UPT  Final  Outcome 


Method/Sample 

N 

N  scores 

Pass  rate 

R 

r 

Stepwise 

Groupl 

430 

9 

.663 

.290* 

.211* 

Group  2 

455 

9 

.659 

.315* 

.202* 

Combined 

885 

12 

.661 

.291* 

Simultaneous 

Group  1 

430 

19 

.663 

.306* 

.227* 

Group  2 

455 

19 

.659 

.326* 

.242* 

Combined 

885 

19 

.661 

.295* 

Not*.  The  column  labeled  "B“  indicates  the  multiple  correlation  of  the  model  based  on  the 
regression  weights  for  that  group.  The  column  labeled  Indicates  the  correlation  of  the  predicted 
outcome  with  actual  outcome  based  on  the  regression  weights  from  the  other  group  (cross-validation). 


*B  3  .01. 

Results  from  the  stepwise  regression  analyses  suggested  that  individual  differences  on  the  AFOQT  and 
BAT  batteries  were  related  strongly  to  final  training  outcome  (Group  1 :  R  =  .290,  £3  .01 ;  Group  2:  R  = 
.315,  £  3  .01).  Table  4  lists  the  test  scores  that  were  included  In  the  final  stepwise  solution  for  each  group. 
A  comparison  between  the  stepwise  UPT  models  for  the  two  half-samples  indicated  that  they  shared  five 
common  predictors  from  the  AFOQT  and  BAT  batteries.  These  included  the  AFOQT  Pilot  composite,  average 
tracking  difficulty  from  the  Time-Sharing  test  and  three  response  time  scores  (Menial  Rotation,  Item 
Recognition  and  Activities  Interest  Inventory).  For  both  groups,  subjects  with  good  hand-eye  coordination 
who  made  quick  decisions  were  more  likely  to  complete  training  successfully.  When  the  regression  weights 
from  each  half-sample  were  applied  to  the  other  half-sample  to  cross-valldate  the  models,  some  reduction  in 
the  validity  coefficients  was  observed.  However,  the  cross-validated  models  were  statistically  significant 
(Group  1 :  r  =  .21 1 ,  £  s  .01 ;  Group  2:  r  =  .202,  £  s  .01). 

A  final  stepwise  regression  model  was  developed  using  the  entire  sample  (Group  1  and  Group  2 
combined).  The  12-variable  AFOQT/BAT  model  (R  =  .291, £  3  .01)  included  11  ofthe  13unique  scores  that 
contributed  to  one  or  both  of  the  half-sample  UPT" models  and  added  one  test  score  that  did  not  contribute 
to  either  half-sample  (AFOQT  Navigator-Technical  composite). 

Simultaneous  Regression  Approach.  A  best-fitting  model  that  forced  all  1 9  AFOQT  and  BAT  scores  into 
the  regression  equation  was  related  significantly  to  UPT  final  outcome  for  both  half-samples  (Group  1 :  R  = 
.306,  £3  .01;  Group  2:  R  =.326,  £3  .01).  Although  the  simultaneous  regression  solutions  Include  redundant 
test  scores  that  do  not  contribute  significantly  in  the  stepwise  solutions,  the  simultaneous  solutions  generally 
appear  more  stable  wnen  cross-validated,  demonstrating  less  shrinkage  in  the  validity  coefficients  (Group  1 : 
r  =  .227,  £  s  .01;  Group  2:  r  =  .242,  £  s  .01). 
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Table  4.  Comparison  of  Stepwise  UPT  Final  Outcome  Prediction  Models  by  Group 


Test  score 

Group  1 

Group  2 

Combined 

AFOQT 

Pilot 

X 

X 

X 

Navigator-Technical 

X 

Two-Hand  Coordination 

X  Axis  Tracking  Error 

X 

X 

Complex  Coordination 

X  Axis  Tracking  Error 

Y  Axis  Tracking  Error 

Z  Axis  Tracking  Error 

X 

X 

Encoding  Speed 

Average  Response  Time 

X 

X 

Mental  Rotation 

Average  Response  Time 

X 

X 

X 

Percent  Correct 

X 

Item  Recognition 

Average  Response  Time 

Percent  Correct 

X 

X 

X 

Time-Sharing 

Average  Tracking  Difficulty 

Average  Response  Time 

X 

X 

X 

Self-Crediting  Word  Knowledge 

Average  Response  Time 

X 

X 

Percent  Correct 

Bet 

X 

X 

Activities  Interest  Inventory 

Average  Response  Time 

X 

X 

X 

Number  of  High-Risk  Choices 

X 

Prediction  of  UPT  Graduatlon/FTD  Outcome 


As  shown  in  Table  2,  over  one-third  of  the  UPT  eliminations  in  this  study  were  attributed  to  reasons  other 
than  poor  flying  training  performance  (Group  1:  55  of  145  eliminees  =  37.9%,  and  Group  2:  53  of  155 
eliminees  =  34.2%,  were  for  reasons  other  than  flying  training  deficiency  [non-FTD]).  The  AFOOT  and  BAT 
batteries  are  not  designed  to  detect  medical  deficiencies,  poor  stress  tolerance  or  lack  of  motivation. 
Therefore,  a  more  appropriate  estimate  of  the  predictive  validity  of  the  AFOQT  and  BAT  batteries  for 
supporting  pilot  selection  decisions  would  be  made  if  only  UPT  graduates  and  FTD  eliminees  were  included 
in  the  analyses. 
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Stepwise  regression  approach.  The  stepwise  regression  approach  yielded  significant  multiple 
correlations  with  UPT/FTD  outcome  in  both  groups  (Group  1:  R  =  .327,  g  <  .01;  Group  2:  R  =  .365,  g  < 
.01).  Table  5  summarizes  the  regression  results,  and  Table  6  lists  the  test  scores  that  were  included  in  the 
final  stepwise  solution  for  each  group. 

Table  5.  Prediction  of  UPT/FTD  Outcome 


Method/Sample 

N 

N  scores 

UPT 

Pass  rate 

R 

r 

Stepwise 

Groupl 

375 

8 

.760 

.327* 

.257* 

Group  2 

402 

9 

.746 

.365* 

.220* 

Combined 

777 

11 

.753 

.330* 

Simultaneous 

Group  1 

375 

19 

.760 

.344* 

.249* 

Group  2 

402 

19 

.746 

.380* 

.260* 

Combined 

777 

19 

.753 

.338* 

dots  The  column  labeled  "B"  Indicates  the  multiple  correlation  of  the  model  based  on  the 
regression  weights  for  that  group.  The  column  labeled  indicates  the  correlation  of  the  predicted 
outcome  with  actual  outcome  based  on  the  regression  weights  from  the  other  group  (cross-validation). 


<  .01. 


When  the  regression  weights  from  each  half-sample  were  cross-validated  with  the  other  half-sample,  the 
resulting  validity  coefficients  were  significant  for  both  groups  (Group  1:  r  =  .257,  g  <  01;  Group  2:  r  = 
.220,  gs  .01). 

A  final  stepwise  model  was  developed  using  the  entire  sample  (Group  1  and  Group  2  combined  [n  =  777]) 
to  determine  a  "best  estimate"  of  the  regression  equation.  This  model  Included  11  of  the  13  test  scores  that 
contributed  to  one  or  both  of  the  half-sample  regression  solutions  (R  =  .330,  g  <  .01). 

Simultaneous  Regression  Approach.  As  with  the  UPT  final  outcome  analyses,  a  best-fitting  model  that 
forced  all  19  AFOQT  and  BAT  test  scores  into  the  regression  equation  was  developed  and  cross-validated  . 
This  model  was  related  significantly  to  UPT  graduation/FTD  outcome  for  both  of  the  half-samples  (Group  1 : 
R  =  .344,  g  s  .01;  Group  2:  R  =  .380,  g  <  .01)  and  was  cross-validated  successfully  (Group  1:  r  =  .249,  g 
s  .01;  Group  2:  r  =  .260,  g  s  .01).  Although  the  stepwise  and  simultaneous  regression  solutions  do  not 
differ  significantly  in  predictive  validity  during  the  model  development  phase,  the  simultaneous  solutions 
generally  appear  more  stable  when  cross-validated. 


IV.  DISCUSSION 

Results  from  the  AFOQT/BAT  cross-val'dation  regression  analyses  were  consistent  with  those  from 
Carretta  (1989).  For  each  half-sample,  individual  differences  in  psychomotor  skills,  Information  processing 
abilities,  personality  and  attitudes  helped  to  reduce  uncertainty  In  making  pilot  candidate  selection  decisions. 
Further,  results  from  the  model  development  and  cross-validation  phases  suggest  that  the  selection  models 
are  robust.  The  significance  of  the  cross-validation  analyses  is  especially  important  because  it  indicates 
suitability  for  use  in  an  operational  setting. 
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Table  6.  Comparison  of  Stepwise  UPT/FTD  Outcome  Prediction  Models  by  Group 


Test  score 

Group  1 

Group  2 

Combined 

AFOQT 

Pilot 

X 

X 

X 

Navigator-Technical 

Two-Hand  Coordination 

X  Axis  Tracking  Error 

Complex  Coordination 

X  Axis  Tracking  Error 

Y  Axis  Tracking  Error 

Z  Axis  Tracking  Error 

X 

X 

X 

Encoding  Speed 

Average  Response  Time 

X 

X 

Percent  Correct 

Mental  Rotation 

Average  Response  Time 

Percent  Correct 

X 

X 

X 

Item  Recognition 

Average  Response  Time 

X 

X 

X 

Percent  Correct 

Time-Sharing 

Average  Tracking  Difficulty 

X 

X 

X 

Average  Response  Time 

X 

X 

Self-Crediting  Word  Knowledge 
Average  Response  Time 

X 

X 

Percent  Correct 

X 

X 

Bet 

Activities  Interest  Inventory 

Average  Response  Time 

X 

X 

X 

Number  of  High-Risk  Choices 

X 

X 

The  validity  estimates  provided  by  the  cross-validated  selection  models  may  seem  low.  It  should  be 
noted,  however,  that  the  magnitude  of  these  correlations  was  limited  by  several  factors.  To  begin  with,  there 
may  have  been  some  restriction  in  range  on  the  abilities  measured  by  the  AFOQT  and  BAT  batteries  because 
these  subjects  had  already  been  screened  on  the  basis  of  their  academic  performance,  aptitude  test  scores 
(i.e.,  AFOQT),  and  flying  performance  in  a  Flight  Screening  Program.  Other  factors  that  may  have  limited  the 
magnitude  of  the  correlations  include  (a)  the  dichotomous  nature  of  the  UPT  outcome  measures  (UPT 
graduation  versus  elimination;  UPT  graduation  versus  FTD  elimination)  and  (b)  the  proportion  of  UPT 
graduates  in  the  sample  (66.1  %  graduates).  Results  from  the  UPT/FTD  analyses  suggest  that  the  validity  of 
the  AFOQT  and  BAT  batteries  against  pilot  training  performance  improves  when  pilot  candidates  who  were 
eliminated  for  reasons  other  than  FTD  are  removed  from  the  analyses.  A  more  sensitive  training  performance 
measure  (e.g.,  flying  grades,  class  standing)  also  may  yield  larger  validity  coefficients. 
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V.  CONCLUSION 


A  combination  of  AFOQT  and  BAT  performance  scores  demonstrated  utility  for  supporting  USAF  pilot 
candidate  selection  decisions.  The  model  development  phase  Indicated  substantial  agreement  between  the 
stepwise  selection  models  that  were  developed  Independently  for  the  two  groups.  Although  the  simultaneous, 
forced-entry  selection  models  did  not  improve  the  prediction  of  training  outcome  In  the  development  phase 
beyond  that  provided  by  the  stepwise  approach,  results  show  that  the  simultaneous  solutions  were  more 
stable  during  the  cross-validation  phase  (the  simultaneous  regression  models  showed  less  shrinkage  In  the 
validity  coefficients  when  cross-validated).  These  models  appear  to  be  sufficiently  robust  to  be  used  as 
adjuncts  to  operational  USAF  pilot  candidate  selection  procedures. 
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